Risk-Sensitive Planning
نویسندگان
چکیده
Methods for planning in stochastic domains often aim for finding plans that minimize expected execution cost or maximize the probability of goal achievement. Researchers have largely ignored the question how to incorporate risk-sensitive attitudes into their planning mechanisms. Since utility theory shows that it can be rational to maximize xpected utility, one might believe that by replacing all costs with their respective utilities (for an appropriate utility function) one could achieve risk-sensitive attitudes without having to change the existing probabilistic planning methods. Unfortunately, we show that this is usually not the case and, moreover, that the best action in a state can depend on the total cost that the agent has already accumulated. However, we demonstrate how one can transform risksensitive planning problems into equivalent ones for riskneutral agents provided that utility functions with the delta property are used. The transformation of a riskseeking planning problem can then be solved with any AI planning algorithm that either minimizes (or sarisrices) expected execution cost or, equivalently, one that maximizes (or satisrices) the probability of goal achievement. Thus, one can extend the functionality of these planners to risk-sensitive planning.
منابع مشابه
How to Make Reactive Planners Risk-Sensitive*
Probabilistic planners can have various planning objectives: usually they either maximize the probability of goal achievement or minimize the expected execution cost of the plan. Researchers have largely ignored the problem how to incorporate risk-sensitive attitudes into their planning mechanisms. We discuss a risk-sensitive planning approach that is based on utility theory. Our key result is ...
متن کاملRisk-Sensitive Planning with Probabilistic Decision Graphs
Probabilistic AI planning methods that minimize expected execution cost have a neutral attitude towards risk. We demonstrate how one can transform planning problems for risk-sensitive agents into equivalent ones for risk-neutral agents provided that exponential utility functions are used. The transformed planning problems can then be solved with these existing AI planning methods. To demonstrat...
متن کاملExistence and Finiteness Conditions for Risk-Sensitive Planning: Results and Conjectures
Decision-theoretic planning with risk-sensitive planning objectives is important for building autonomous agents or decision-support systems for real-world applications. However, this line of research has been largely ignored in the artificial intelligence and operations research communities since planning with risk-sensitive planning objectives is more complicated than planning with risk-neutra...
متن کاملUtility-Based HTN Planning
We propose the use of HTN planning for risk-sensitive planning domains. We suggest utility functions that reflect the risk attitude of compound tasks, and adapt a best-first search algorithm to take such utilities into account.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002